
• Ratent • 
I Office J 



PRIORITY 
DOCUMENT 

SUBMITTED OR TRANSMITTED IN 
COMPLIANCE WITH RULE 1 7. 1(a) OR (b) 



Kl/QB 2004 / 0 0 1 3 5 4 




INVESTOR IN FEOFLB 



The Patent Office 
Concept House 
Cardiff Road 

NeWQQEt- 



South Wales ^ 

NPic 8^ 0 4 MAY 20W 



WIPO 



PCT 



I, the undersigned, being an officer duly authorised in accordance with Section 74(1) and (4) 
of the Deregulation & Contracting Out Act 1994, to sign and issue certificates on behalf of the 
Comptroller-General, hereby certify that annexed hereto is a true copy of the documents as 
origmally filed m connection with the patent application identified therein. 



In accordance with the Patents (Companies Re-registration) Rules 1982, if a company named 
m this certificate and any accompanying documents has re-registered under the Companies Act 
1980 With the same name as that with which it was registered immediately before re- 
registration save for the substitotion as, or inclusion as, the last part of the name of the words 
public Imnted company" or their equivalents in Welsh, references to the name of the company 
m this certificate and any accompanying documents shall be treated as references to the name 
with which it is so re-registered. 

In accordance with the rules, the words "public limited company" may be replaced by d 1 c 
pic, P.L.C. or PLC. J f- ' 

Re-registration under the Companies Act does not constitute a new legal entity but merely 
subjects die company to certain additional company law rules. 




Signed V-A ^2—^* 
Dated 27 April 2004 

PRIORITY 
DOCUMENT 

SUBMITTED OR TRi^haSMTTTED IN 
COMPLIANCE WITH RULE 17.1(a) OR (b) 

An Executive Agency of the Department ofLrade andlnHiistrv 



I 



P.002''015 



For Offldai U8< 


' 7 APR 2003 




o7fiPRo3 E79fi029-1 Di0092_ 
POI/7700 0.00-030788C7'"**^' 








-7 APR 200S 








Your refftronc© Fatent K (tJK) 


0307884.7 



The 

Patent 
Office 



Request for grant of a 
Patent 



Form 1/77 



Patents Acl 1977 



1 TBte of Inventbn 



COMPUTER BASED SYSTEM FOR 
MANXFUXATING DIGITAL MEDIA 



2. Applicant's details 

Rrst or only applicant 
2a If applying as a corporate taody: Corporate Nama 

Inteniet Fro Video Limited 

Country 
Giveat Britain 



2b If applying as an individual or partnenship 
Surname 

Forename 



2d 



Address 



Mount Pliant House 
2 Mouat Pleasant 
Huattogdttti Road 



UK Postcode CB3 ORN 
Countiy GreatBritam 
ADP Number 



df-flPR-2003 11:00 FROM: ORIGIN LDhDDN 




□ 

2d 



Secqnd applicant fif any) 
Corporate Name 



Country 



2& Surname 



Forenames 



2f 



Address 



UK Postcode 

Country 
ADP Number 



3 Address for seivloe 
Agent's Name 

Agent's Address 



Origin Lirnited 

5Z Muswell Hill Road 
Lj>ndon 



Agenf s postcode N1 0 3JR 



Agent's ADP C03274 

Number -/^-7 o (45:7 o^'^ 




1-2003 11:00 FROMzORIGIN LJDNDQN * +44-OT?2030S43 TO:+01633 B14444 P.004''015 



4 Reference Number 




Patent K(UK> 




5 Ctaimii^ an earlier appticatton date 




An earlierflllng date Is cta}me± 


- 


YeeQ 


NO H 




Number of earlier 




application or patent number 
Rlbngdale 




15 (4) (Divisional) 8(3) 12(6) 


37(4) 


□ 


□ □ 


□ 


6 D^arafion of piloiify 




Counby of filing 


Priority Application Number 


Finns Date 









m-PPR-S0B3 11:00 FROI: ORIGIN LXINDON •<-44-a07SeS0643 TO: 401633 B1WI4 




7 Inventorship 

The appnpant(8) are fhe sate Inventoi^ointinveritors 
Yes Q H 



8 Checklist 



Claims 2 
Abstract o 



Contlniiatfon ^eets 
Description $ 
Drawings 



Priorit/ Documents ^^ee|{^ 
'nanslations of PrioiHy Docnjments 

Patents Forni 7/77 ^>6ss^ 
Palisints Form 9^ 

P&iwsa Form 1 0/77 -^i^p^^ 



9 Request 



We request the grant of a pateni on the basis 
of this application 

(Origin Umiied) 



-2003 11:00 FRDMiORIGiN UDNDON * * +44-e0r7E090S43 TO:+01633 B14WJ P-00B''015 

! * * • 

DUPLICATE 

1 

COMPUTER BASED SYSTEM FOR M&NIPblATJW DIGITAL MEDIA 
Technical Held 

Tlws JoTwiioa pejates to a compatec softwaie system for mftniptdflling digital media. 
Backgtou&d A^t 

5 Applicadon software for editing digital video is ai;i excremdy sophisticated, and powcrM tool 
because it is pxttnarily desfgned far, and sold to^ the video ptofosionaL Such an individual 
requites access tc i»atiy complex fuocdoos and is prepared to invest dme and c£E6xt fa. 
learning to become skiJlcd fa. tbw we. Historically, the terminology and convcotions of 
Digital Ediring have evolved from a ttadidon^ Sim « ditfag cOTirpnment whete tushes ate cut 
10 and spliced toged^ei w tell, a story ot follow a script As distal mixet technology advanced 
new techniques were combined wiria, these coavcntfottsil nwitJaods tc? fopm the early 
pfaoecKfag soiEtware based digital editots. 

To the video oar film piofcBSXOoal edhtDg fe second mxaxfi (ind the coinplexirics of a time- 
ba«cdm<siia go tinnoAwdsincM, hawing alie^ " 
15 are able no concentHUB on ifae nuances of diflscKCOt (wJitwg padsagps, of which thete fire 
cuaoy. 

Convendoaally thrae packflgea, thiougjb, ifae use of ft Giaqpbical Ubci Intetfece (GUl)^ attempt 
to ptovide an atistracriott of the media to teems of many sepatate tracks of -video a»d awdio, 
Hiese are jreprcscjMcd oo lihe output denrice ia symbolic fashion and piovision is made for 
20 itttcjacwng with these rqaescntadotis ^xasl% an input devfce such as a mouse. Typically die 
putpose is to cixatc a new piece of media as an output file, cocaposcd by aascmbUng dips or 
st^eats o£ videa and audio along a tioaeUnt tbflt represents die temporal ordering of 
£tames. Spedal effects enich as wipes and fedra can be incotpocated, transparent ovedaya can 
be adde4 colour and contiflBt can be Rdjvistcd. The list of msnjpfuladonB made po^ble by 
25 sudi tools is very long indeed, A typical syatsm is described in, fore 

J., ct. fll, "Gsaphicad usest intetfiace for a video cditii^ system", U.S. Patent 6,4<J9,71l. 

It is possible, however, diat an individnal who k a conamuei: of media, ather thaa a 
producer, may need to perftsnn a sitnpk edittog opettttion on ft media file in order to 
acccanpliah thdt primitty taskj for egcample to gj^e a muld-media picsei)«:a4»>n. In dds case 
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snch tools bskvt t3idt dcAMTbades. The^ may be too cspcajsivc to justify indhddtajaJly^ or to 
ham coough of in oxdex to be avaikblc when ox where seeded The limited nmouiatt of U9e 
smd tihe dmaJil &acdo0 of tlie capabilities used in soch sitrntioos may make ifhetn im€caiu>23(dc 
The steep leaxulng carve associated tf^ltii such tools may meao ifaat an jn&ppxopjdflto amouai; 
5 of effete is eajpendcd on scsoaediix^'that Is not the pxiflaaiy occupatioo or conceta of the tool 
user. For occasional or in&equcot use "dieie wi]! be reluctance on the part of any user 
repeatedly to smtch environments or learn atid teledtn tXCW tools to perjGodm simple lost 
minute tasks. 

This situation pvallels previous well-known situations where improvements in the 
10 availability, usability and piine/peEfoxmance rfludo of consumca: IT cquipxneat, has caused a 
signiBcatxt reappraisal of what is pcsdiblc and a change in behaviour to esqploit new 
possibilities. For esBitipkp the production of blgh-qualiiy printed docmnents was ojoce the 
province of bi^ly sldUfid people using e^ensive and spedalised cquipmcnju Now anybody 
with a need to produce auch a document, who has access to a compucex and a word- 
15 processing progtam. Can do so, A simikr shift in paradigm Is happening in Digits VJdeo 
Editiiigy there ?s a need fi>r highly accessible and iisable tools lihat focus on the needs 

of a new generation of user^ and not nccess^y vy to recrteaue the feel of a traditional video 
editing environmcot 

Such tools must exhibit an intuilxvc, predictabte and. consistent behaviour as understood by a 

«• 

20 new gencratioo of digjltal media pio&ssiDnals who may wcU be eaccremely &ini]iax wxdi the 
manipukdozi of documents of vadous kinds darorgh a compuisr's GUI, but be completely 
unfanuKar with the charactedsdcs of time-based media. The tools need not supercede lon^g 
esuablished and specialised tools wed by trained professionals bul^ xathec, provide a bxic^ in 
order chat new users may be as camfiortahle working widi time based media as they ate 

25 wo9^kbg "^riA. documents. 

Convennonally, video editor's axe structured as spedalised 'monolidsJc* applications. Cutzent 
software technology, howevet, is well capable of adding sophisticated editing funi:tions to 
unrelated, applicauons through the use of softwate *plu^illS^ The Mlctosojft® DirectShov?® 
Editibcig Services is an application piDgtamm.tng interface (API) that is built ox?) top of 
30 Microsoft® DitectShowK^ that allows video editing capnbiMes to be added to applications • 
In this example filtcx?> implemented as Coramon Object Module COmponenitS> ajre created 
and inter-connccted to form filter graphs. As another example the QuickTime track based 
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3 

fiy- r'}^»pr*i«tT ff fa t^ft frnifadfliton many modem day edftots such as Adobe p£apicge« Jt offers . 
embedded API based access, tesidcnt bdow tbfi ^pjic^don layEr diat ptcrvidcs for simple 
track majnipulatlon. There b no reason why such pbg-los may not be deployed in 
applkatiiOOfl that are not, pdmsJcQy, designed fox "video editing. 

5 

Acxotdio^y, these arc the ^tttaibutea of a tool that is mote ^ropxiate to the needs of such a 
ooosumet. * 

I. Simple ajcid iotui*re t» use; in pardcular, Ihtk time and effott 1& tequieed to Icam 
enough to accomplish &c task in hand. 

10 * 2. Terminology and workflow consistfent vAlUx a shift in convendon towards action led 
digital media edim© e,g, 'Jog^ to select as with modem VCR's and a simple crop 
ability to tdm die tiuminglcoigtb of a piece of media. 

3. Available ts^^eocvw and whenever needed, max If the user did not fbresee *he need 
for such a tool tmial tbat Deed etopped up^ Le.» the edit c^bflity is provided as an 

15 intriDfiic part of the enyiirament byway ofany player of die media. 

4. Ptcyvldes a consistent interiace to the user irrespective of the typo of 'container' ' 
^jplicadon it is associated with. It would look escacdy die same whetiber incorporated 
Into an electtofik text doctiment» a spreadsheet, or a slide prcscntatioa> 

5. Persistence of modiSc^na; e.g. the user opetia media ot^ecti or a document 
20 coataiijfag an embedded media ob}cct and espects any changes ihey make to persist 

between sessions. 

XMsdoausQ of Inveniioii 

The iiiNrcfltloa relates to a method for ad.diog the capability for mediarmanipulatten to 
sofcv^ tnedia pkyets, such ihat this capabiEty is Itttdttdc tso the media player, and which 
2$ comprises a set of tools ensure that confiisteat behoviowal, viaual and fiinctipnal aspects 
arc mairLtaiiwd betroen medi^L player applications. 

Bjdcfly, the invendon wodss as lEoUows. 

Accordiqg to one aspect of ihc imrendon a Gtfipbiod User Intecface <GUI) for editing is 
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( 

In the pxcfis jxcd embodiment of thk aspca of xht iavendon & plog-in modtdjC is loaded jnto 
the computfic^s memory to provide the specific foncdofijftUty xequked. ThiB software modulo 
has ioterfoce^ tio a media deltvexy subsystem, .sut^ &s the Microsoft® Dif ectSho^w® 
Acdbiteceure &ir die Mlccosoft® \X^kdaw$® pktfomi that pxovidcs socvices for stteamifig^ 
5 bufifedog syfldif onisation, decodliig and irendetidg of video and audio. Media is sUejvned 
isxto a local cadhe xbAt provides fox fine-^giain sctubblDg *jogf and UoopSngf of short secdons 
aioimd in and oat points. A set of Insttucdons is devised fof each piece of media and its 
intecaction ^vich a timeline^ Specific dexnentB are constxocted in monocjr to process th^e 
instmcdons and subsequently handle the media in a suitable &rm» as compatible -'Kith the 
10 ^r^^p play axchitectote in opciationi Hew ^d modified elemtsnts maybe constmctsed and 
xeconstructcd as regoked, each element may process but is not limited to a slfii^e set of 
instructions or piece of media. 

, The funcuonaliiy provided by this softwaixs module consists of:- 

• Gtapbics mndeting to allow combinadon and/or ovexky of gc^lbi^:^! data ^ot the GUI 
15 mth pcbcels tibat are decoded from die video parcof the media file and lendeiccd into the 

^co atea on the sciieen. 

• A cache foi: potions ofthetn^diadibe in 

20 * A state madhine, whose tcansxdons gudde a user through a sequence of intezacdonB with a 
graphical user interface (GUI). 

• Gr^hics that in^temcnts yssual feedback of die cwcccnt st^te to fbe user, 

25 • Gtapbics that implements a visual metaphor that provides die user with an intmtiiTe 
, uodetstandbg of die operation of the intcr&ce, 

• An reporter for die persistence of th.e chosen manipulations, for example; to "Save" the 
processed media to memory cteaciug a new media object or create a new set of 

30 instmcdons that dcscribea the pieciae opcxadon required to effect die manipuladons for 
pUybadc Including but not limited to, such insOMcdon as rsefetenccs to sections within a 
mmote piece of media. 
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• GaapWcsdiat allows labdsofTariouBlypee to be 0da«d»rign^ 
fik in oixkr ideodfy lianm M sudsT 

. GtaiiiicslfaatinawgiiheddEinidfmofaci^ 
ni<»<<w file are eacatmteted in notmal pb^bw^^ 



5 



In this embodiment of this ftsjpect of die kwcnilott the GUI is provided by modules withi» 
tiM software ficamewodc ihat Implenxeiits the naedk player, by &b addition o£ visiWff user 
10 ineetfece components (buttons, teat boxes, etc) either orcifaid ok actaaHy burnt iato Ae 
xendered ^deo window ^.e. the pkds vnSsxso. ca'ite ftamestore by the vidcd reodexer arc 
ovetwijaen). In ihe Windows MSedisi® atduBscmre, where software 61ter ©aph components 
iro Bated toffrthcr to implemfint a media pliiy^ 
xendexer filtet or an arodmy fibert 
15 m another embodiment of this aspect of die invendon the GUI is provided by software 

taodnks, other dMtt those embedded widdn the medJa pkycr fiswacwodc, such as ArtivsK 

Qonbcols. 

Acooirfhig to another aspect of djelnTCorion elements am exchanged between jnatanccs of a 
naodia player. 

20 In the preferred embodiment of this aspect of the invention Ac Windows® Media 
eovkoftmettt is ea^loyed such that one instance of the player may be used to tnaxt^ th« 
«njastEi'' titiM:line, While another allows cl^ to be trunoMd to 

ddgged snd dropped into die "masteif playec induce. At this dme ihe recent instance 
may chose to combine die alter goph for die new piece of medi* wijh dioae already in 
25 adstcace; or it may chose to xcconstmet a new filter gfsph based on die coJi4»leaity and 
lequired iMOCaoioJi of the cntrem: drndinc ol^ects. 

Accotdhig no anotbcx aspect of the invention a process flow is ptovided diat provides for 
vflLttiidoed nsets » achieve ihdr goal wid> mhiimnm eeEbtt, ajad disttacdon ftom thek pwroary 
task. 

30 In die preferred embodiment of this aspect of die iaventiofl state macUnea help walk die 
users dtton^ opetatKxos » iwtrid mistates and distil die eomptexfay oCedidng into bounded 
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and ea^ to tuadeFstand processea Visual and tacdle feedback vriil provide tapid confidence 
Jn ijbLC mdc and aid prc^cs^ e.g» to slim down a. media object ibe user \(dll Bdcct n '*St»:fi • 
Heie'' in poittt and guided tomcds a '^top Kcxc** out point. 

EfFcctiw confkmation metiioda axe employed to infottn and protect the actions of the user, 
5 vkusl mctaphops \wn be piovided fironx die embedded editor level to identify nodes of tho 
cujrroc^t machine. For example, the video \7ind0w maj- shew a iHImstrfp -with the cujocnt 
ficame highli^ted subsequent fiaines ttOfmal and previous frames, ie. those croppi?d, "with a 
stdkc out marker. 

According to another aspect of dbe invention meta-tkta in the media file is tQCCgph^d by the 
iD system and used as a stceam of control infemmdon that is used to assist editing opetatk>ns. 

In one embodimjcnt of ffhis aspect of the invendon the mcta-data may include but is not 
limited to: 

• Timccodc, 

• Oosed caption 

15 • Bdit points used during the creation of the media, - 

» Format-dependent properties such as GDP boimdaries in MPEG, 

• Data jgfcnerated aa a result of ppst-pxoccssiog Siuch as shot change infonuadojGu 

The conttol infocmatioa ideadfies significant points in the medJa ^nd tri^pts events tihiat 
20 Cause instructional or infomiative inifoimamn tx* be displayed. For e3camplo dialogue boxes 
may pop up dudng pJaybsiclcTuddi labels such as "^tart Here" (EN) ojc^Stop Here" (OUT) . 

Industrial Applfa^at^ty 

As a. simple example of th^ u&e of the mvendon consider this eccnaiio* Ap. educadon 
profession^ is preparing matenals for a lecture they are about t30 gjtve« A part of diis is an 
25 diecttonic slide ptesentatioa with some of die alidfis contaioing embedded media olqccts* Op 
running tbrouj^ the presentation they realise diat it ovctyruns the tttne allowance if all the 
media dips are played in thdbr entirely. Using die system described here the medk be 
cjwckly and efEciently tadmmed to suit t^K)aixcmeotd» ^without the need for s^sratching 
envkoriments orappileadons* 
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CLAIMS 

L A oamputErbasaa system fotiMid^ 

for nifidi^manipulatioii to Boftwwe media pbym, such that ihis cipabflity is Intdnsfc to 
5 the media player, and which compriscss a set of tools that en&we that consistent 
bebflwioufid^ visual and fiinctbaal aspects ate mfthitaiiied between media player based 
applicadoMp 

2. The sysmn of daim I where media inc^ 

3. The system of daims 1 & 2 >ffhete toattipiilatioix hidudea, but is not confined to, the 
10 opetadons of one or mote o£ 

(a) Bdidngj tdanroiiig; annotadng; efiBscts; tcaasitioiia; ^pcaianM; ptesenlAtiowi 

4. Tbe^yatemof daima 1 «3compridsiiigoncoxjcc^ 

(a) A sofisrare compotiesit d^at Implcmcntfl a cache fi>i pofrions of the mftdi^ fik In the 
mcmo^ of the cHent madbhuu 

15 (b) A software component that implements a process ccjuivalent to a state machine, 

TsAiose transitions guide a user dirOTJigh a sequence of JnteiacriDns \tfiiih a graphical user 
interfe.ce (GUI). 

(c) A software grapWcs component of the GUI, that ImplemiSttts visual feedbadk. to the 
user of the corrent stai^ 

20 A software gcapWw component of the GUI that impJements a visual metaphor diat 

piD\4iea the user with dn intditivc utiderfitandii« of the operadon of the interfece. 

(e) A software graphics xendetet component dwt allows combination and/ or owday of 
gcaphical date for the GUI with pkels dial ace decoded ^ 
61c and rendered into the video area on the sCteen. 

i 

2S (f) A software compcanenl: iii»t. Implcmoiltft an export of tie pKOCCSScd *ned3a to 
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(g) A softwa^ com{>onent that unplctoents the ability to tead A dcacdptbn file(s) and 
constrnct playback in accordance set imtcacdonSr oc write such mstmcdo&s » 
cuDTcat playfaack. 

(h) A sofitware comf oaenC of tke GUI th« allows labels or td^ers of vsuious types to 
5 be Added to sjgnificatit parts of the media file in order to identify them as such. 

5. Hib system of daims 1-4 vsdiete kbds include^ but axe not confined co^ edit is md Qut-^ 
points^ shot boundaries, Gixyup-Of^FiictuxB (GOF) boundades, dbscd-capdon text and 
dznecode. 

6. The system of claims 1-5 vhe^ the td^ggets indude, but Are not confined to^ initiate 
10 pop"Up9» hold firames for a given duration, loop and messaging. 

1. The system of daixns 1-5 addit^on^y compri^iiig; 

A Bofinrare decoder cottxponcnt that maps meta-data contained in the medi^ file to 
labels, ^ete the mcta-data indudes^ but is not confined to, shot boT^Kbujesi Group-Of- 
Hctore (GOF) boundacLes, doscd-c^ption md dmecode. 

IS 8. The system of claims l-^T additionally comprising: 

A softv^are a^t component that maps aspects of the intecacrim behaviour of the uscx 
into configuration, infomxadon dvit may modify a^ects of die behaviour of liie GUI. 

9» The system of claims 1-8 additMMwJly fiompriHing; 

20 A media file that may opdondly be selected and played by the user, whJd?. provides 
instmcdon in dae use of the G-XIL 
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